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Abstract 

A scaling law developed by Amraoui et al. is a powerful technique to estimate the block error probability of finite length 
low-density parity-check (LDPC) codes. Solving a system of differential equations called covariance evolution is a method to 
obtain the scaling parameter. However, the covariance evolution has not been analytically solved. In this paper, we present the 
analytical solution of the covariance evolution for irregular LDPC code ensembles. 

Index Terms 
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I. Introduction 

Gallager invented low-density parity-check (LDPC) codes (TJ. LDPC codes are linear codes defined by sparse bipartite 
graphs, called Tanner graphs. Peeling algorithm (PA) Q, JJI] introduced by Luby et al. is a sequential iterative decoding 
algorithm for the binary erasure channel (BEC). As PA proceeds, edges and nodes are progressively removed from the original 
Tanner graph and the so-called residual graph is left at each iteration. The residual graph at each iteration consists of variable 
nodes that are still unknown and the check nodes and the edges connecting to those variable nodes. The decoding successfully 
halts if and only if the residual graph vanishes. It is known that PA and brief propagation (BP) decoder have the same decoding 
result. 

The scaling law developed by Amraoui et al. J6) is a powerful technique to estimate the block and bit error probability of 
finite length LDPC codes. Let and lj be random variables representing the number of edges connecting to the check nodes of 
degree i and the variable nodes of degree j, respectively, in the residual graph. Then, the scaling parameter is obtained from the 
mean and the variance of r\ . The means of Vi and lj are determined from a system of differential equations which was derived 
and analytically solved by Luby et al. 0. The covariances of r.i and lj also satisfy a system of differential equations called 
covariance evolution which was derived by Amraoui et al. [6|. However, the analytical solution of the covariance evolution 
has not been known. Therefore, one had to resort to numerical computation to solve the covariance evolution. 

In 0, Amraoui et al. proposed an alternative way to determine the variance of r%, though only at the decoding threshold. 
Thereby they have given the analytic expression for the scaling parameters without using covariance evolution. They used BP 
decoding instead of PA. This method was applied to irregular repeat-accumulate codes in J9), iflOl and to turbo-like codes in 
ifm and was extended to binary memory less symmetric channels in (8). 

Denote by £ the total number of edges in the Tanner graph. Let pi be the random variable which is 1 if the edge i conveys 
an erasure message from a variable node to a check node, and otherwise, in the BP decoding. The method in [5| analyzed the 
random variable M := f-i m trie BP decoding and derived the analytical expression for the variance of M. Finally, they 

did make an unproved assumption that the random variable r\ — E[ri] in PA is proportional to the random variable M — E[M] 
in BP and under this assumption they have given the analytical solution for the variance of r\. 

However, no such assumption is needed if the covariance evolution is solved analytically. Moreover, we can obtain the 
variance of r\ at any channel erasure probability. In this paper, we present the analytical solution of the covariance evolution 
for irregular LDPC code ensembles. 

II. Preliminaries 

In this section, we recall some basic facts on the finite length analysis of LDPC codes under iterative decoding. We also 
introduce some notations used throughout this paper. 
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sakaniwa} @ comm. ss.titech.ac.jp . 

Manuscript received January 1, 20**; revised January 1, 20**. The material in this paper was presented in part at IEEE International Symposium on 
Information Theory (ISIT09), Seoul, Korea, July 2009. 
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A. Ensemble and Channel Model 

In this paper, we consider irregular LDPC code ensembles [2J. An irregular LDPC code ensemble is defined by the set 
of bipartite graphs with variable nodes and check nodes. Let C and 7Z be the sets of degrees of variable nodes and check 
nodes, respectively. Irregular LDPC code ensembles are characterized with the block length n and two polynomials, X(x) = 
J2iec ^i xl1 an d p( x ) = 12ieiz Pi xt1 ' where A^ and pi are the fractions of edges connected to variable nodes and check nodes 
of degree i, respectively. The derivatives of A(x) and p(x) are A'(x) = X]i6£(* ~ l)AiX 4-2 and p'{x) = J2ien(^ ~~ l)/°iX 4-2 , 
respectively. 

We assume the transmission over the binary erasure channel (BEC) with channel erasure probability e. 



B. Peeling Algorithm 

The peeling algorithm (PA) is a sequential iterative decoding algorithm for BEC. It is know that PA and brief propagation 
(BP) decoder have the same decoding result. A residual graph at each iteration consists of variable nodes that are still unknown 
and the check nodes and the edges connecting to those variable nodes. The decoder proceeds as follows. 

a) Initialization: Variable nodes receive the channel outputs. The variable nodes receiving the known values send their 
values to the check nodes connected to them. Then the variable nodes sending their values and edges connecting to those 
variable nodes are removed from the graph. 

b) Iteration: The decoder uniformly chooses a check node of degree one in the residual graph. The chosen check node 
sends the value computed from the received values to the adjacent variable node. The variable node propagates this value to 
all adjacent check nodes. The variable node is removed together with its edges. 

c) Decision: If the decoder does not find any check nodes of degree one in the residual graph, then the decoding halts. 
If the residual graph is empty, then the decoding succeeds, otherwise it fails. 



C. Analysis of Residual Graph 

Let t denote the iteration round of PA and £ be the total number of edges in the original graph. We define 

t 

r:=-. (1) 

Define a parameter y such that dy/dr = —l/(eX(y)) and y = 1 at r = 0. Let l k ,t and r^j denote random variables representing 
the number of edges connecting to the variable nodes of degree k and the check nodes of degree i, respectively, in the residual 
graph at the iteration round t. Let d c be the maximum degree of check nodes. We define 7Z := {1, 2, . . . , d c — 1}. We also 
define a set of random variables 

V t := {l kjt \ keC}U {r M \keTZ}. 
To simplify the notation, we drop the subscript t. For X £ V U {r<j c }, we define X(y) by 

Xiv) := El. 

For i £ C and j £ {2, . . . , d c } as the block length tends to infinity, Luby et al. [3| showed that X(y) is given by 

U(y) = e ^v\ 

f i(y) = x (y- 1 + p(i)), 

where x := eA(y) and x := 1 — x. We define 8^ x ' Y \y) by 

5^ Y \y) := ^fn, (X,Y£V), 

where Cov[X, Y] is the covariance of X and Y . To simplify the notation, we drop y. In 0, 0, Amraoui et al. showed that 
§i x X) satisfy the following system of differential equations for irregular LDPC code ensembles as the block length tends to 
infinity. 



d8^ Y ) _ _e 
dy y 



^\ dZ dZ 



zev 

+ f(X,Y) 



(2) 
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and this system of differential equation is referred to as covariance evolution. Let Is.x be the indicator function which is 1 if 
the condition inside the braces is fulfilled and otherwise. Define e(y) := J2iec ^ = X V' x ' := IT' a := ^2iec if = X V x~ X 
and Gj(y) := iilj±l^A_ The terms in the covariance evolution are given by the following for k, s G C , i G TZ and 
3 G {1,2,. ..,4-2} 

df^ _kh k 
dh e 2 ^ fc=s > e ' 



Qjih) 



0, 



9rj 

2a-k-lGi 



9/( r 3') a - 1 

= i— — ( 7 {^+i} _ 7 {i=j})> 

dl k e e y 



and for k,s E £ and i, j G 72. 



f)f{rd c -i) „ _ 1 

^— = -(^-1)^(1 + ^-1}), 
e y 

x' 

[I {i = j} {r j+1 + r 3 -) - i"{i= i+ i}^ - /o=<+i} r i] ■ 

Initial conditions of the covariance evolution are also given by Amraoui et al. @j, (6). For i,j G TZ U {c? c } and fe, s G £, 
the initial conditions of the covariance evolution are derived as follows: 



5^M(l)=I {k=sy kX k ee, 
5^(1) = -k\ k eeGi(l), 

S(w)(i) = I {i=j} ifi(l) - V u (l) + X'(l)eeGi(l)Gj(l), 



where e := 1 — e and 



■S 



i+j ffls — i-j 



D. Scaling Law 

Let Ps(e, n) be the block error probability under BP decoding for channel erasure probability e and block length n. Threshold 
is defined by 

e* := sup{e G [0, 1] | lim P B (e, n) = 0}, 

71— >QO 

and characterized via density evolution as follows: 

e* = sup{e G [0, 1] | y > 1 - p(l - eAfo)), Vy € (0, 1]}. 

The curve of the block error probability for finite length LDPC codes is divided two regions which called waterfall region 
and error floor region. In the waterfall region, the block error probability drops off steeply as the function of channel erasure 
probability. In the error floor region, the block error probability has a gentle slope. A scaling law is a technique to estimate 
the waterfall region. The scaling law is based on the analysis of the residual graphs. 

In (6), the block error probability Ps(n, e) is given by 

a 
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where a is slope scaling parameter depending on the ensemble and the Q-function is defined by 

1 



Q{z) := 



2 dx. 



In O, the slope scaling parameter is derived as 



V* (ri,Pl) U- 



dn 



(3) 



where y* is the non-zero solution of r\(y) = at the threshold (i.e. define y* such that y* = 1 — p(l — e*A(y*))) and £ is the 
total number of edges in the original graph. 

III. Main Results 

We show, in the following theorem, the analytical solution of the covariance evolution, for irregular LDPC code ensembles. 
The proof shall be given in Section [IV] 

Theorem 1. Consider transmission over the BEC(e). Let r be the normalized iteration round of PA as defined in ([T). A 
parameter y is defined by dy/dr = — l/(eA(y)). For an irregular LDPC code ensemble, i, j E TZ and k, s G C, in the limit of 
the code length, we obtain the following. 



§(hM 



hsl]$l s 



F+ e -^[k(y s ~l) + s(y k -l) 



+I {k =s}kl k {l-ey k ), 



.si 



SV.n) = [F— - el s (y s - 1)] (—Gj I {]=1 



sl s , F -\- x „ , 

-— G i(— ex v )' 



(4) 



(5) 



^•)=-F(^ Gi -7 {i=1} )(^G,-7 {i=1} 
+ G A (F'^-£ e 2 S A 



y 2 *- 2 +x 2 )-V-, 



+ (/y=i}Gi + 7 {i=1} Gj) [x(e - x) 
+I{i=j}in + J {i=J=1} (e - x) 2 , 



F' - x n 



(6) 



where F := f [<?(tf ~ 1) + - 1)] and F' - ^ - 2 ^ e^y 21 - 1 - (e - e)x. 

Using Theorem Q] we can obtain the following corollary. 

Corollary 1. Let e* be the threshold of the ensemble under BP decoding, n be the block length and £ be the total number of 
edges in the original graph. For irregular LDPC codes, the slope scaling parameter a is given by 

-p(x*) 2 - p{x* 2 ) - x* 2 p'{x* 2 ) 1 - 2x*p{x*) 



p'(x*) 2 

+ x* 2 -e* 2 X(y* 2 )-e* 2 y* 2 X'(y* 2 ) 



p>(x*) 
fn 1 



(7) 



where x* := e*A(y*) and x* := 1 



Proof: Since ri| e ».„» 
we have from @, 



and 

oy 



0, we see that 1 — y* = p(x*) and p' (x*)e* X' (y*) = 1. Using those equations, 



e~;y' 

--x* 2 [p(x*) 2 -x* 2 p'(x* 2 )-p(x* 2 )} 
+x* 2 p'(x*)[l-2x*p(x*)] 
+(x*p'(x*)) 2 [x* 2 - e* 2 X'(y* 2 )y* 2 - e* 2 X(y 2 *)}. 

Recall that fi = x(y — 1 + p(x)). We see that 



-A(y )x p (x ). 
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From (O, we can obtain (0. ■ 

Remark 1. The result of Corollary [T] is the same as the result in J5| for irregular LDPC code ensembles. In particular, for 
(d v , d c )-regular LDPC code ensembles we can write 



a = e * / ^-y i ) 

6 V d v { x* y*>' 

IV. Lemmas and Proofs 

In this section, we state three lemmas and prove Theorem Q] Section IPV-AI HV-Bl and HV^Cl give (0), (O and ©, respectively. 

A. Lemma and Proof of (0 

In this section, we give a lemma to prove (0 and we prove (0. 
1) Lemma to Prove (0: 

Lemma 1. Define U^ 1 ^ := ^0- - For k,s G C, we have the following equations. 

§(hM s(ih,h) §(isM 
2 kslj a ~ {kl k y ~ {sis) 2 



ey k — 1 ey s — 1 

klfc sl s 
2e,y k -\ V s -L 

+ 7<V-V)- (10) 



Proo/- Define 5(**»'*0 = Y, se c <5 (Ws) - From the covariance evolution, we have 

dS^M , s 7 kL k 



—x 



V e 2 e 2 e 



\ e 2 e 2 e 

-xf (lkM . (11) 

a) Proof of $8$): From ( fTTT ). we have the following equation: 

1 _ () 

' fcs (fo 

From initial conditions, we have 

^ ks „ i 

k,s£C i£C 

This leads to ©. 

£>) Proof of Obviously we can get (0 for k = s. From ( fTTT l, we have 

d ,6<> lk > l *K 1 dd^M k + s 



dy v kslkh ' kslkh dy kslkhy 

,f(h,l.) §(h,ls) ^(We) 



From those equations, we have 



§(lk,ls) §(h,h) (JC^,^) ~ 



dy V kslkh (kl k ) 2 (sl s ) 2 

x f(!kM x f{ik,ik) x f(is,h) 



-2- 



k si L?Ii c k^li 



(12) 
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for j 7^ k. This differential equation can be solve as follow: 

§{hM gih-h) §(is,i.) 



1 1 



c, 



ksl k l s (kl k ) 2 (sl s ) 2 kl k sl s 
with a constant C which can be determined from initial conditions. From initial conditions, we get 

1 1 



Thus we have for k =^ s 



C 

k\k s\ s 

§(lk,h) §(lk,lk) §(h,h) e yk _ I e yS _ 2 

kslJs (kl k ) 2 {sl s ) 2 kl k sl s 

This leads to ©. 

c) Proof of [TUi : From (O, we have for all k,s G C 

6 (iM = [ ^ {ey k_ 1) + tk iey s_ 1)]l{k ^ } 



The sum of this equation for s G C is written as follows 

T^ - 1 )' 2 



,(W.> = ™ {ey k _ l) + - 1) - kl k (ey k 1) 



sec 



H ^S { - lk ' lk > + kl k 2^ — 

K sec s 



Combining ( fT2l with this equation, we have 

fj ,X(lk:lk) \ 



dy\(kl k ) 2 



sec 



sec s 



j^(h,ik) .— _, 



j{ik,ik) 

(kl k ) 2 kl k y^ €V 1 + ey^ V ^' 



a > k i% , 2 , fc 



du(lk[ls) =K (l k ,l k ) _ _ ^jj(lk;l,)_ 

dy ' y 



where 



From this equation, we have 



Note that 

— dy = \ogxy. 
V 

Since ([T3l is a first order differential equation, it can be solved as follows: 

Udk-M = l I e ( K dkM _ K «.,i.)) dy + i C , 

C J 6 

with a constant C which is determined from initial conditions. Note that 

eK {lkM dy 

x'y + x x'y—(k—l)x „ 1 
fcAfe kl k y 

•^+E^ J ^}+^ -logy. 

K iec K 



dy 



(13) 
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We get 

ey k — 1 ey s — 1 



kljz Slg 

l/2ey fe -l 2ey s -l 



e\k s 1 

From initial conditions, we have U^ lk ' ls \l) — f (jgjj- — jj-) and C — — 1 " 8 26 , Therefore we have 

fcZfe si s e V A; s / 

This leads ([Toll. 

2) Proo/o/@-" By definition of £/^ ;/s >, we have 

s(l k ,l k ) 

k l l k 



The sum of this equation for k 6 £ is written as follows: 



kec 

From (O, we see that for all k,s E £ 

1 I 



2 k 2 l k 2 s 2 l 

The sum over this equation for k,s E £ is written as follows: 

§(lk,h) §(lk,ls) ^ ^ ey k -1 



keC k,seC keC 



Combining (15[ with (O, we have 



l^l^- = -2^T + ^—e (16) 



kec " k " kec " kec 



From ( flOl ). we have 

^[ &L r(w s ) = - (e2/S _ 1) _ 2e 



fee£ 



sL s 



_ E ^ + * E w-i) . 

^— ' fc e -^-^ k 

kec kec 



Combining ( fl4l > with dT6b and ( fTTI i. we obtain 

S (lm = _ (fU! F + 2e ^ (yS _ 1} + s |- s(1 _ a)- 

From this equation and (O, we can obtain (01) for fc, s E £. 



B. Lemma and Proof of (0 

In this section, we introduce a lemma to prove (O and we prove (|5). 
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1) Lemma to Prove @-' 

Lemma 2. Define := Y^ ie c jS {li ' rj \ A^*) := J2jen A.( ljl ' r i\ S<^^) := ~S^ r ^ - ^-<5 (Zs ' rj) , S^' 1 '^ 

^2 j^Tz S^ li ' ls ' r ^ and Gs := Y^jeH^i = ^ or 3 ' e ^ anc ^ k,s £ C, we have the following equations. 





' — ' 2 


-1)(G S ^- 






/ 
















x' 

= -e(?i-- 











— exGs, (18) 
=i})-ecGi, (19) 

s ' 

(20) 

y s -U 

s 

(21) 

We use (fT8l and d20l > to prove the basis of the mathematical induction in proof of ( fl9l ) and d2TI ). respectively. 

Proof: First, we will derive differential equations. We define <j" s >'V) := £^ fce £ <5(' f! ' r ", d^ lk ' r ' E > :— Y^je-R.^ lk ' r ^ and 
fi{ik,r dc ) .— g(lk,ls) _ ^(Jfcjruj^ respectively. From the covariance evolution (0, we can write for j £7Z and k £ C 

dy ey y 

-j—tfVw+i) _ (j(i*,^)) 5 ( 22) 

where 

- xp"'^ . 

We define A^' 7 "^ := £ fce£ |5 (,fc,r A A^ r ^ := A^'^ and £> (ifc ' rs) := EjeTl £> (Zfc ' rj) . From ([22), we have for 

ken 

^- = V ^ _ A (te.ri)). (23) 

aw ^ — ' fc a; 

The sum over this equation for j £ It is written as the follows: 

s*"*' 

+ rf c ^A( (s ' rE ). (24) 
a: 

From d22l . we see that 

^ x klk 

Define S(W.;r,) := - fi-CW.;!.) := - and := i^El _ ^EL, From (g5j, we have 

fcFfc 



j_(5('«i.'.i'-i+0 _ (26) 
a; v y 



for k,s £ £ and j e 7?.. The sum over this equation for j £ 71 is written as the follows: 

_( dc _l)i S (l kl i.ifc) 



djy fcZfe sZ s x 

+ rf c -5 (Zfc '^ ;rs) . (27) 

a; 
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a) Proof of (U&l): Since ( l24b is a first order differential equation, it can be solve as follows Q: 



fce£ fce£ 



Cat' 



A 



kec 



with a constant C which is determined initial conditions. From initial conditions, we see that 

A«w\l)=ee(l-d ePde e d °- 1 ). 
From this equation, we can determine C = —d c pdj~ Thus, we get 



A^) = ee ~£ **(yk _ 1} ( Gs fL _ i) _ ~ exG 



kec 



Hence, we have ( TT~8T >. 

b) Proof of [19[: Since d23l is a first order differential equation, it can be solve as follows: 

J kec 

with a constant C; Ejrj which can be determined from initial conditions. 

We solve (|28| > by mathematical induction for j E {2, 3, . . . , d c — 1}. From ( TT~8T >. we have 



(28) 



A Cte.^e) = e ~ e y ?L(yi - 1)-G dc - IxG 



iec 



where Gd c 



-— — -. Using the same method in the induction step, we can show that A^ ls ' rd "-^ fulfill (|T9). 
We show that if A ( - ls ' r J+ 1 '> fulfill (O, then also A ( - ls ' r ^ fulfill (O. Using the induction hypothesis, we have 

J2 — i j-A^' r ^ 



kec 



x *■ — ; % 

iec 



A 



iec 



'Gfe + G^^ -1)(^- 2^) 



A2 



Using integration by parts, we have 



iec 



(29) 



iec 



Note that = -j^G j+x + {j - l)^Gj for j e{2,...,d c - 1}. From <|29), we have 

e V—rG j+1 ^ - 1) + 2^ -— - dy 



iec 



iec 



(30) 



1 In a way similar to Section HV-Blbl we perform this calculation. 
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^ J jG j+1 x'edy = -^ =T G j . 



From the sum over (f30b and d3lT >. we have 

1 D<- h ' r ^ .x' 



/ 7 E : j-A^+^)dy 

I x J % x 

J ieC 

iec 



Thus, we have 



= ee£ -(^ - 1)G — - ?G^ + Q s , r3 . 



i x 



From initial conditions, we have A^'^l) = -eeG,-(l) and C fe ,^ = 0. Hence we obtain 



tec 



This leads to (QjO for j G {2, 3, . . . , d c - 1}. 
Note that A^< ri ) = A^- r ^ - Y,fj 2 l A^- r '\ We have 

A^-'i) = ee^ ^(y* - 1){G X - - l) - EGja. 

Hence we obtain (fl9l >. 

cj Proof of SM: Since © is a first order differential equation, it can be solve as follows 

J x c klk sis 

X 



Note that 



-(d c -l)^S^« ;te )]dy + Ga: dc . 



where 



k _ 2 , 2(o;') 2 -x"x^-l- 



:=eC7 s [-2-y fc + (fc-l)^ 



+ (4- l)— e(y 



x' , k x'y + x y k — 1 > 



Note that 



Thus we have 



x x A: 

/ \K^dy = -e(G s - - + eG^" 1 . 



y k -l y s -l, 



x ' * k s 
eGv{y k - x -y^ + Cx^. 



From the initial covariance, we have S^ l ^\l) = and G = 0. This leads to ©. 
of) Proof of $21}: In a way similar to Section H"V-Blb| we can obtain (|2"TT i. 



IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. *, NO. *, JANUARY 20** 



11 



2) Proof of 0: From definitions of S^ k ' lB ' r ^ and A( ls ' r3 \ we see that 

sis 
e 



= [F^-eL( y s -l)](^-/ { , =1} ) 



Thus, we obtain (15). 



C. Lemma and Proof of dS]) 

In this section, we introduce a lemma to prove <JSJ and we prove (|5). 
7) Lemma to Prove 

Lemma 3. We define ( 5( r i' , ' l: ) := ^ fce7 j 5 t " ri ' Vk ^ and (5( rE < rs ) := X)je7i 5^ r i ,rs \ For j G 7?., we have the following equations. 

5 {r^) = _ pruLo^ _ x y + F ' Gs (^ Gs _ i) 

v X X ' 

W _a + d 2 c f 2 dc - V dc , de , (32) 

^' rs) =-^ s -l)(^-/ { , =1} ) 

+ jP ' G .(^ Ge - i) -GsG^AV'- 2 

+ 4r dc xG, + ^ idc + I -^{G J - %=i}G E ) 

+ I{j=i}d c f dc (e- x). (33) 

We use (l32l to prove of the basis for the mathematical induction in proof of (1331 . Similarly, we use d33l to prove of the 
basis for the mathematical induction in proof of ©. 

Proof: First, we derive differential equations. We define 5^ ri ' r ^ ;= ^2j e -ji5^ r " rj \ :— J2 ie -jz^ ri ' r ^ an d 

§i r d c ,rj) .— §{is,rj) _ ^(rs.rj) _ p rom covariance evolution (O, we get 

^ = - + jslw*) - (» + 

+ L>( r - r ^, (34) 



where 

kec y 

Define D^ ri ' r ^ := T. 3 ec D^ ri ' r ^ and D( rE > rs ) := E 4 e£ £,(r " rE) - For <5 (r ^ rs) , we have 

dy x 

- —{d c - 1)^'^ +D ( - r *' ns \ 
x 

The sum over this equation for i £ TZ is written as follows: 



= -2—[(d c -l)S^' r ^-d c 6^ rs ' r ^] 

+ D (rs ' rs K (35) 
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a) Proof of fi32l: Since d35l ) is a first order differential equation, it can be solve as follows: 

S (r E ,r s ) = x 2d c j J_[£,(r s ,r E ) _ 2 {d c - l) — 6^' rs) ]dy 

J X c X 



^(-G S -1) 2 + C7 S (-G S -1)F' 

v x a: 



G|. ie 2 \ i y 2l/ 2 + C rS;r 



r 2d c 



with a constant G rSirE which can be determined from initial conditions. From initial conditions, we have 

£(r E ,r s)(1) = A '(l) e g( dcpdce d c -1 _ 1)2 + £ g 

- 2eed c p dc e dc ~ l + d c p dc e dc - d c p dc e 2d < 

and G r5 , !rs = d 2 ./^ ~ d c pd c - Thus we have 

^ro.nO = _ F(^G E - l) 2 + G S (^G S - 

- Gl^ie 2 ^" 2 + _ y^. 

This leads to (1321 1, 

b) Proof of §33$: In a way similar to Section HV-Blbl we can obtain (133V ■ 
2) Proof of (0: ( f34b can be solve as follows: 

= x i+i f J_f D (ri,rj) _ ^isin+m) _ ^j§(rur j+ i)\ dy 

J X t+: > X X 

+ C rurj x i+j . (36) 
This equation can be solved by mathematical induction for i, j e {2, 3, . . . , d c — 1}. Note that from ( 1331 

= GjGd c [-F^-f + F' X -L-Y J eW" a + A 



x x 

sec 



Via 



for j € {2, 3, . . . , d c — 1}. Using the same method in the induction step, we see that S^o-ur dc -x) f u i m i ([gj. 

We show that if {6^^ £ {2,3,...,<2 c -l},i+j = fc + 1} fulfill ©, then {6^^ e {2, 3, . . . , d c -l}, i+j = k} 
fulfill (|5). Using the induction hypothesis, we can solve 



S — 1 \ r , ( S — 1 

i 



From the initial condition, we get 



S 



Thus, we have © for £,j G {2, . . . , d c — 1}. 

"3=2 



Note that <5( r " ri ) = <5( ri ' rs ) - <5 (r, ' rj) - We show that S^ r " ri ^ fulfill © for i e ft. Hence we obtain ©. 

V. Conclusion 



In this paper, we have analytically solved the covariance evolution for irregular LDPC code ensembles. We have also obtained 
the slope scaling parameter. 
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